U.S. Department of Justice 



Federal Bureau of Investigation 

Washington, D.C. 20535 


MARCIA HOFMANN ESQ 

ELECTRONIC FRONTIER FOUNDATION June 9 2008 

454 SHOTWELL STREET 
SAN FRANCISCO, CA 94110 


Subject: INVESTIGATIVE DATA WAREHOUSE 
FOlPANo. 1058805-000 


Dear Ms. Hofmann: 

The enclosed documents were reviewed under the Freedom of Information/Privacy Acts (FOIPA), Title 5, 
United States Code, Section 552/552a. Deletions have been made to protect information which is exempt from disclosure, 
with the appropriate exemptions noted on the page next to the excision. In addition, a deleted page information sheet was 
inserted in the file to indicate where pages were withheld entirely. The exemptions used to withhold information are marked 


below and explained on the enclosed Form OPCA-16a: 

Section 552 Section 552a 

D (b)(1) °(b)(7)(A) □ (d)(5) 

K (b)(2) 0(b)(7)(B) 00(2) 

D (b)(3) 8(b)(7)(C) D(k)(1) 

8(b)(7)(D) D(k)(2) 

8(b)(7)(E) Q(k)(3) 

0(b)(7)(F) Q(k)(4) 

D (b)(4) 0(b)(8) o(k)(5) 

D (b)(5) o(b)(9) o(k)(6) 

0 (b)( 6 ) o(k)(7) 


17 page(s) were reviewed and 17 page(s) are being released. 

o Document(s) were located which originated with, or contained information concerning other 
Government agency(ies) [OGA], This information has been: 

□ referred to the OGA for review and direct response to you. 

□ referred to the OGA for consultation. The FBI will correspond with you regarding this 
information when the consultation is finished. 


K You have the right to appeal any denials in this release. Appeals should be directed in 
writing to the Director, Office of Information and Privacy, U.S. Department of Justice, 1425 
New York Ave., NW, Suite 11050, Washington, D.C. 20530-0001 within sixty days from the 
date of this letter. The envelope and the letter should be clearly marked “Freedom of Information 
Appeal" or “Information Appeal.” Please cite the FOIPA number assigned to your request so that it 
may be easily identified. 

□ The enclosed material is from the main investigative file(s) in which the subject(s) of your request was 
the focus of the investigation. Our search located additional references, in files relating to other 
individuals, or matters, which may or may not be about your subject(s). Our experience has shown, 
when ident, references usually contain information similar to the information processed in the main ’file(s). 


Because of our significant backlog, we have given priority to processing only the main investigative file(s). 
If you want the references, you must submit a separate request for them in writing, and they will be 
reviewed at a later date, as time and resources permit. 

B See additional information which follows. 


Sincerely yours, 


David M. Hardy 
Section Chief 
Record/Information 
Dissemination Section 
Records Management Division 


Enclosure(s) 


The enclosed documents represent the sixth and final release that will be made with regard to your 
request pertaining to the Investigative Data Warehouse. 

For your information, some of the enclosed pages contain information about other subject matters. We 
consider this information “Outside the Scope” of your request, and have redacted the information and marked it as 
“Outside the Scope.” 

The first page of this correspondence reflects that 17 pages were reviewed for this release. There were 
actually 39,870 pages reviewed, however, a further review determined that 39,853 pages of this material are not 
responsive to this request. 



EXPLANATION OF EXEMPTIONS 


SUBSECTIONS OF TITLE 5, UNITED STATES CODE, SECTION 552 

(b)(1) (A) specifically authorized under criteria established by an Executive order to be kept secret in the interest of national defense or foreign 

policy and (B) are in fact properly classified to such Executive order; 

(b)(2) related solely to the internal personnel rules and practices of an agency; 

(b)(3) specifically exempted from disclosure by statute (other than section 552b of this title), provided that such statute(A) requires that the 
matters be withheld from the public in such a manner as to leave no discretion on issue, or (B) establishes particular criteria for 
withholding or refers to particular types of matters to be withheld; 

(b)(4) trade secrets and commercial or financial information obtained from a person and privileged or confidential; 

(b)(5) inter-agency or intra-agency memorandums or letters which would not be available by law to a party other than an agency in litigation 

with the agency; 

(b)(6) personnel and medical files and similar files the disclosure of which would constitute a clearly unwarranted invasion of personal privacy; 

(b)(7) records or information compiled for law enforcement purposes, but only to the extent that the production of such law enforcement 

records or information ( A ) could be reasonably be expected to interfere with enforcement proceedings, ( B ) would deprive a person 
of a right to a fair trial or an impartial adjudication, ( C ) could be reasonably expected to constitute an unwarranted invasion of personal 
privacy, ( D ) could reasonably be expected to disclose the identity of confidential source, including a State, local, or foreign agency or 
authority or any private institution which furnished information on a confidential basis, and, in the case of record or information compiled 
by a criminal law enforcement authority in the course of a criminal investigation, or by an agency conducting a lawful national security 
intelligence investigation, information furnished by a confidential source, ( E ) would disclose techniques and procedures for law 
enforcement investigations or prosecutions, or would disclose guidelines for law enforcement investigations or prosecutions if such 
disclosure could reasonably be expected to risk circumvention of the law, or ( F ) could reasonably be expected to endanger the life or 
physical safety of any individual; 

(b)(8) contained in or related to examination, operating, or condition reports prepared by, on behalf of, or for the use of an agency responsible for 
the regulation or supervision of financial institutions; or 

(b)(9) geological and geophysical information and data, including maps, concerning wells. 

SUBSECTIONS OF TITLE 5, UNITED STATES CODE, SECTION 552a 

(d)(5) information compiled in reasonable anticipation of a civil action proceeding; 

(j) (2) material reporting investigative efforts pertaining to the enforcement of criminal law including efforts to prevent, control, or reduce 

crime or apprehend criminals; 

(k) (l) information which is currently and properly classified pursuant to an Executive order in the interest of the national defense or foreign 

policy, for example, information involving intelligence sources or methods; 

(k)(2) investigatory material compiled for law enforcement purposes, other than criminal, which did not result in loss of a right, benefit or 

privilege under Federal programs, or which would identify a source who furnished information pursuant to a promise that his/her identity 
would be held in confidence; 

00 ( 3 ) material maintained in connection with providing protective services to the President of the United States.or any other individual pursuant 
to the authority of Title 18, United States Code, Section 3056; 

(k)(4) required by statute to be maintained and used solely as statistical records; 

(k)(5) investigatory material compiled solely for the purpose of determining suitability, eligibility, or qualifications for Federal civilian 
employment or for access to classified information, the disclosure of which would reveal the identity of the person who furnished 
information pursuant to a promise that his/her identity would be held in confidence; 

(k)(6) testing or examination material used to determine individual qualifications for appointment or promotion in Federal Government service the 
release of which would compromise the testing or examination process; 

00(7) material used to determine potential for promotion in the armed services, the disclosure of which would reveal the identity of the person 
who furnished the material pursuant to a promise that his/her identity would be held in confidence. 
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4 Custom Software Applications 
4.1 IDW-S Data Ingest Applications 

Figure 4.1.1 is the dataflow diagram for the IDW-S data ingest process. 



Figure 4.1.1 IDW-S Data Ingest Dataflow 
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Data ingest processing on IDW-S includes the following: 

• ACS Processing: The ACS data is a subset of the Electronic Case File (ECF) subsystem. 

b2 

b7E 


/ACS 

provides ADD, MOD, and DELETE record types. 

• IntelPlus Processing: The IntelPlus data includes of the following CT file rooms: 


b2 

b7E 
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• SAM Net Processing: The SAMNet data consists of cable traffic messages received by the 


FBI. 


T2 1 



I 


• JICI Processing: The JICI data consists of one file room where each case file and serial is 
represent ed by a directory. Each directory contains the text and image files associated with 
the serial / \ 

I I JICI data is provided in 

entirety. 


MiT AP Processing; The MiTAP data consists o 


file archives of news messages. 


b2 


b7E 

• VG TOF Processing: VGTOF is a structured data source that is currently available in IDW 
V 1 4~~ | The VGTOF data is 

composed of an ASCII source file of structured data records anc j 

files. The records for each individual are com bined into a document. | | 

, VGTOF data is provided in entirety, replacing 

the previous data. 1 
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Note: Hardcopy versions of this document must be verified for correct version number with the IDW CM Document Control Library. 
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Privileged Users Guide (PUG) IDW Operational Services 
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4.1 Operations 


The IDW system is broken up into three subsystems, each with a different set of responsibilities 

DOCLAB System 

IDW-S contains data from the following data sources with security classification indicated in the 
table below: 
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Note: Hardcopy versions of (his document must be verified for correct version number with the IDW CM Document Control Library. 
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1DW Operational Services 
PUG NG-OM-006 1.12 


FBI Automated 
Case System 
(ACS) 


Secret and below 


FBI IntelPlus 

Secret and below 

FBI Secure 

Automated 

Messaging 

Network 

(SAMNet) 

Secret and below 

FBI National 
Crime Information 
Center (NCIC) 

SBU 

FBI Records 
Management 
Division (RMD), 
Document 
Laboratory 
(DocLab), FBIHQ 

Secret and below 

MiTAP 

Unclassified 


to 2 

b7E 


Note: Hardcopy versions of this document must be verified for correct version number with the IDW CM Document Control Library. 
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The SPT-specific data sources wi ll include: 

• Financial Center (FinCenl 

• INOFiy 

• -.Selectee 


Unified Name Index (UNI) extracts 
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Note: Hardcopy versions of this document must be verified for correct version number with the 

PUG NG-OM-0061.12 
FOR OFFICIAL USE ONLY 


IDW CM Document Control Library. 


Page 16 



UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse - Secret (IDW-S) 
System Security Plan 
24 January 2005 
Version 1.5 


F ederal Bureau of Investigation 
Information Resources Division 
Data and Information Management Section 



Investigative Data Warehouse - Secret 

(IDW-S) 

System Security Plan 


Document Version 1.5 
24 January 2005 


UNCLASSIFIED // FOR OFFICIAL USE ONLY 


ALL INFORMATION CONTAINED 

HEREIN IS UNCLASSIFIED 

DATE 05-20-2008 BY 67159 /DHH /HKG/VTA 



UNCLASSIFIED // FOR OFFICIAL USE ONLY 

Investigative Data Warehouse - Secret (IDW-S) 
System Security Plan 
24 January 2005 

Version 1.5 


Outside the Scope 


1.2.2 Supported Projects 

IDW-S is an FBI enterprise program/system and provides data and data processing/analysis 
services to FBI agents and analysts as they perform counter-terrorism, counter-intelligence, and 
law enforcement missions. The initial focus for the IDW-S Core Subsystem has been to support 
data analysis/data mining for the following FBI groups/activities: 

Counter-Terrorism Division (CTD) 

Special Event Unit 

In addition, scanning/OCR performed in the DOCLAB-S subsystem supports the following FBI 
projects/programs: 


Joint Intelligence 
Committee 
Investigation (JICI) 

Secret 

KddWiE IVlAhagentSrtt^Division 
Federal Bureau of Investigation 
J. Edgar Hoover FBI Building 
935 Pennsylvania Avenue, NW 
Washington, DC 20535 

IntcIPlus 

Secret 

1 1 

information Resources Division 
Federal Bureau of Investigation 
J. Edgar Hoover FBI Building 
935 Pennsylvania Avenue, NW 
Washington, DC 20535 
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Automated Transfer of Raw Data to IDW-S 


Raw data is automatically transferred to the IDW-S system from approved data sources in 
accordance with an Interconnection Agreement, Memorandum of Understanding, Memorandum 
of Agreement or Interface Control Document. IDW-S V 1 receives update data by the following 
means: 


ACS update data is transmitted to the IDW-S systeni " 
IntelPlus update data is transmitted to the IDW-S svstenl 


SAMNet update data is transmitted to the IDW-S svsterri 


VGTOF data is transmitted to the IDW-S system \ 

Open Source News data is transmitted to the IDW-S systerr/ - 

TT/"'T A : * __ tmw n 


The JICI library is static and is not updated on IDW-S VI . 
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Parse and Format (Concatenated) Data to Individual Files (HTML) 

- Initial processing of ra w data file i I 

I b ata into individual serial records (in the case of ACS ECF), 

document s (IntelPlus, J1CI, Open Source News), messages TSAMNetY or files 
(VGTOF)j ' , 
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3.5.1. 1 IDW-S Core Subsystem Data Processed 

Table 3.5.1 .1 below outlines the IDW-S datasets and information about transfer and ingest 
processing for each source. 




W/SSlKISi 


ACS 

Electronic 
Case Files 
(ECF) 

FBI Automated 
Case System 
(ACS) 

Secret and below 



Outside the Scope 


b2 

b7E 
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3.9.9 Indirect Connections 


3.9.9.1 IDW-S Core Subsystem Indirect Connections 


^nm 

HgBfef 

11111 



FBI Automated 
Case System 
(ACS) 

Secret 

FBI 

FTP 


FBI Intel Plus 

Secret 

FBI 

FTP 

FBI Secure 

Automated 

Messaging 

Network 

(SAMNct) 

Secret 

FBI 

FTP 

j-'BI National 
Crime 
Information 
Center (NC1C) 

Unclassified/SBU 

FBI 

CD-ROM 

FBI Document 

Conversion 

Laboratory 

(DocLab). 

Records 

Management 

Division (RMD), 

FBIHQ 

Secret 

FBI 

CD/DVD 
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3.9.9.2 SPT Subsystem Indirect Connections 
None. 


3.9.9.3 DOCLAB-S Subsystem Indirect Connections 
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